Research and Advanced Technology for Digital Libraries
Abstract. Communication and collaboration with other people is a major theme in the information seeking process. Collaborative querying addresses this issue by sharing other users ’ search experiences to help users formulate appropriate queries to a search engine. This paper describes a collaborative querying system that helps users with query formulation by finding previously submitted similar queries through mining web logs. The system operates by clustering and recommending related queries to users using a hybrid query similarity identification approach. The system employs a graph-based approach to visualize the query recommendations. 1
Dynamics of Genre and Domain Intents.

Factors affecting click%2Dthrough behavior in aggregated search interfaces.

What can quantum theory bring to information retrieval.

Examining the information retrieval process from an inductive perspective.

The Four Ladies of Experimental Evaluation.

Learning Aggregation Functions for Expert Search.

From Entities to Geometry Towards Exploiting Multiple Sources to Support Relevance Prediction.

Filtering Documents with Subspaces.

From Entities to Geometry Towards Exploiting Multiple Sources to Support Relevance Prediction.

Knowledge Modeling in Prior Art Search.

Rethinking preservation validation with the preserved object and repository risks ontology %28PORRO%29.

From federated to aggregated search.

Exploring a Multidimensional Representation of Documents and Queries %28extended version%29

Current research in focused retrieval and result aggregation.
Abstract. Both focused retrieval and result aggregation provide the user with answers to their information needs, rather than just pointers to whole documents. Focused retrieval identifies not only relevant documents but also which parts of those documents are relevant, thus reducing the time it takes the user to navigate in a document. Result aggregation is used when the best way to fulfil the user’s need is to draw from many different information sources (different collections, documents, or parts of the same document), and to aggregate these into a single result, thus reducing the time it takes the user to fulfil their information need. This special issue includes seven papers showing the breadth and depth of the current state of research in these two branches of information retrieval. They include descriptions of live result aggregation systems, and experimental focussed retrieval systems including sentence retrieval, question answering, and entity ranking; as well as metrics for passage retrieval. To introduce this special issue, we provide an overview of the work presented in these papers. 1.
XML Retrieval

Evaluation in Context.

Specificity Aboutness in XML Retrieval.

A Quantum%2DBased Model for Interactive Information Retrieval.

Structured Information Retrieval and Quantum Theory.

Visualizing the problems with the INEX topics.

A Task%2DBased Evaluation of an Aggregated Search Interface.
Abstract. This paper presents a user study that evaluated the effectiveness of an aggregated search interface in the context of non-navigational search tasks. An experimental system was developed to present search results aggregated from multiple information sources, and compared to a conventional tabbed interface. Sixteen participants were recruited to evaluate the performance of the two interfaces. Our results suggest that the aggregated search interface is a promising way of supporting nonnavigational search tasks. The quantity and diversity of the retrieved items which participants accessed to complete a task, increased in the aggregated interface. Participants also found the aggregated presentation easier to access to retrieved items and to find relevant information, compared to the conventional interface. 1
Relationships in Structured Text Retrieval.

Structure Weight.
Existing ranking schemes assume all term occurrences in a given document are of equal influence. Intuitively, terms occurring in some places should have a greater influence than those elsewhere. An occurrence in an abstract may be more important than an occurrence in the body text. Although this observation is not new, there remains the issue of finding good weights for each structure. Vector space, probability, and Okapi BM25 ranking are extended to include structure weighting. Weights are then selected for the TREC WSJ collection using a genetic algorithm. The learned weights are then tested on an evaluation set of queries. Structure weighted vector space inner product and structure weighted probabilistic retrieval show an about 5 % improvement in mean average precision over their unstructured counterparts. Structure weighted BM25 shows nearly no improvement. Analysis suggests BM25 cannot be improved using structure weighting.
Structured Document Retrieval.
Focussed structured document retrieval aims at retrieving best entry  points from where users can browse to access relevant document components in  the document structure. In this paper, we report on the development, implementation  and evaluation of best entry point retrieval strategies derived from  user studies designed to elicit what constitutes a best entry point.
Term Statistics for Structured Text Retrieval.

XML Retrieval.

A Quantum%2Dbased Model for Interactive Information Retrieval %28extended version%29

Second international symposium on information interaction in context.

Second international symposium on information interaction in context.

Proceedings of the 2nd International Conference on Information Interaction in Context

Focused Access to XML Documents

%22Narrowcast yourself%22 de
Current developments in information technology are leading to increasing capture and storage of information about people and their activities. This raises serious issues about the preservation of privacy. In this paper we examine why these issues are particularly important in the introduction of ubiquitous computing technology into the working environment. Certain problems with privacy are closely related to the ways in which the technology attenuates natural mechanisms of feedback and control over information released. We describe a framework for design for privacy in ubiquitous computing environments and conclude with an example of its application.  INTRODUCTION  Information technology can store, transmit and manipulate vast quantities and varieties of information. Whilst this potential is essential to government, public services, business and individuals, it may also permit or entail unobtrusive access, manipulation and presentation of personal data (Parker et al., 1990; Dunlop &amp; Kl...
Structural relevance a common basis for the evaluation of structured document retrieval.

%22Narrowcast yourself%22 de
Current developments in information technology are leading to increasing capture and storage of information about people and their activities. This raises serious issues about the preservation of privacy. In this paper we examine why these issues are particularly important in the introduction of ubiquitous computing technology into the working environment. Certain problems with privacy are closely related to the ways in which the technology attenuates natural mechanisms of feedback and control over information released. We describe a framework for design for privacy in ubiquitous computing environments and conclude with an example of its application.  INTRODUCTION  Information technology can store, transmit and manipulate vast quantities and varieties of information. Whilst this potential is essential to government, public services, business and individuals, it may also permit or entail unobtrusive access, manipulation and presentation of personal data (Parker et al., 1990; Dunlop &amp; Kl...
Generation of Query%2DBiased Concepts Using Content and Structure for Query Reformulation.

Locating relevant text within XML documents.
Traditional document retrieval has shown to be a competitive approach in XML element retrieval, which is counter-intuitive since the element retrieval task requests all and only relevant document parts to be retrieved. This paper conducts a comparative analysis of document and element retrieval, highlights the relative strengths and weaknesses of both approaches, and explains the relative effectiveness of document retrieval approaches at element retrieval tasks.
Sound and complete relevance assessment for XML retrieval.
In information retrieval research, comparing retrieval approaches requires test collections consisting of documents, user requests and relevance assessments. Obtaining relevance assessments that are as sound and complete as possible is crucial for the comparison of retrieval approaches. In XML retrieval, the problem of obtaining sound and complete relevance assessments is further complicated by the structural relationships between retrieval results. A major difference between XML retrieval and flat document retrieval is that the relevance of elements (the retrievable units) is not independent of that of related elements. This has major consequences for the gathering of relevance assessments. This paper describes investigations into the creation of sound and complete relevance assessments for the evaluation of content-oriented XML retrieval as carried out at INEX, the evaluation campaign for XML retrieval. The campaign, now in its seventh year, has had three substantially different approaches to gather assessments and has finally settled on a highlighting method for marking relevant passages within documents – even though the objective is to collect assessments at element level. The different methods of gathering assessments at INEX are discussed and contrasted. The highlighting method is shown to be the most reliable of the methods. Categories and Subject Descriptors:
Workshop on aggregated search.
Singapore. Nine paper were presented in three sessions and in a fourth session—joint with
Workshop on aggregated search.
Singapore. Nine paper were presented in three sessions and in a fourth session—joint with
Comparative Evaluation of XML Information Retrieval Systems

INEX 2002 %2D 2006 Understanding XML Retrieval Evaluation.

Using XML Logical Structure to Retrieve %28Multimedia%29 Objects.

Using Topic Shifts for Focussed Access to XML Repositories.

Feature%2D and Query%2DBased Table of Contents Generation for XML Documents.

Combining Evidence for Relevance Criteria A Framework and Experiments in Web Retrieval.

Combining Multiple Sources of Evidence in XML Multimedia Documents An Inference Network Incorporating Element Language Models.

Combining Multiple Sources of Evidence in XML Multimedia Documents An Inference Network Incorporating Element Language Models.

Overview of the INEX 2007 Ad Hoc Track.
Abstract. This paper gives an overview of the INEX 2007 Ad Hoc Track. The main purpose of the Ad Hoc Track was to investigate the value of the internal document structure (as provided by the XML markup) for retrieving relevant information. For this reason, the retrieval results were liberalized to arbitrary passages and measures were chosen to fairly compare systems retrieving elements, ranges of elements, and arbitrary passages. The INEX 2007 Ad Hoc Track featured three tasks: For the Focused Task a ranked-list of non-overlapping results (elements or passages) was needed. For the Relevant in Context Task non-overlapping results (elements or passages) were returned grouped by the article from which they came. For the Best in Context Task a single starting point (element start tag or passage start) for each article was needed. We discuss the results for the three tasks, examine the relative effectiveness of element and passage retrieval. This is examined in the context of content only (CO, or Keyword) search as well as content and structure (CAS, or structured) search. 1
INEX 2007 Evaluation Measures.
Abstract. This paper describes the official measures of retrieval effectiveness that are employed for the Ad Hoc Track at INEX 2007. Whereas in earlier years all, but only, XML elements could be retrieved, the result format has been liberalized to arbitrary passages. In response, the INEX 2007 measures are based on the amount of highlighted text retrieved, leading to natural extensions of the well-established measures of precision and recall. The following measures are defined: The Focused Task is evaluated by interpolated precision at 1 % recall (iP[0.01]) in terms of the highlighted text retrieved. The Relevant in Context Task is evaluated by mean average generalized precision (MAgP)wherethe generalized score per article is based on the retrieved highlighted text. The Best in Context Task is also evaluated by mean average generalized precision (MAgP) but here the generalized score per article is based on the distance to the assessor’s best-entry point. 1
Overview of the INEX 2007 Entity Ranking Track.

StoryBank an indian village community digital library.


Where to start reading a textual XML document%3F
In structured information retrieval, the aim is to exploit document structure to retrieve relevant components, allowing the user to go straight to the relevant material. This paper looks at the so-called best entry points (BEPs), which are intended to give the user the best starting point to access the relevant information in the document. We examine the relationship between BEPs and relevant components in the INEX 2006 ad hoc assessments. Our main findings are the following: First, although documents are short, assessors often choose the best entry point some distance from the start of the document. Second, many of the best entry points coincide with the first relevant character in relevant documents, showing a strong relation between the BEP and relevant text. Third, we find browsing BEPs in articles with a single relevant passages, and container BEPs or context BEPs in articles with more relevant passages.

Evaluating relevant in context document retrieval with a twist.

Examining topic shifts in content%2Doriented XML retrieval.

XML retrieval db%2Fir in theory%2C web in practice.

Learning%2Dbased summarisation of XML documents.
Documents formatted in eXtensible Markup Language (XML) are available in collections of various document types. In this paper, we present an approach for the summarisation of XML documents. The novelty of this approach lies in that it is based on features not only from the content of documents, but also from their logical structure. We follow a machine learning, sentence extractionbased summarisation technique. To find which features are more effective for producing summaries, this approach views sentence extraction as an ordering task. We evaluated our summarisation model using the INEX and SUMMAC datasets. The results demonstrate that the inclusion of features from the logical structure of documents increases the effectiveness of the summariser, and that the learnable system is also effective and well-suited to the task of summarisation in the context of XML documents. Our approach is generic, and is therefore applicable, apart from entire documents, to elements of varying granularity within the XML tree. We view these results as a step towards the intelligent summarisation of XML documents.
Examining topic shifts in content%2Doriented XML retrieval.

Evaluating XML retrieval effectiveness at INEX.

Advances in Information Retrieval
This paper captivates the reader by presenting an overview of the topic detection and tracking (TDT) problem, whose purpose is to organize broadcast news stories by the real-world events that they discuss. The paper describes the research problems considered in all three phases of the TDT and focuses on the solutions developed at CIIR for one of the problems, namely the detection problem--that is, identifying when new topics have appeared in the news stream. The approach discussed is both practical and technically interesting as it presents both new algorithms and modifications of existing IR techniques for the TDT problem
Advances in XML Information Retrieval and Evaluation

Investigating the exhaustivity dimension in content%2Doriented XML element retrieval evaluation.
INEX, the evaluation initiative for content-oriented XML retrieval, has since its establishment defined the relevance of an element according to two graded dimensions, exhaustivity and specificity. The former measures how exhaustively an XML element discusses the topic of request, whereas specificity measures how focused the element is on the topic of request. However, obtaining relevance assessments is a costly task. In XML retrieval this problem is exacerbated as the elements of the document must also be assessed with respect to the exhaustivity and specificity dimensions. A continuous discussion in INEX has been whether such a sophisticated definition of relevance, and in particular the exhaustivity dimension, was needed. This paper attempts to answer this question through extensive statistical tests to compare the conclusions about system performance that could be made under different assessment scenarios.
The Use of Summaries in XML Retrieval.
Abstract. The availability of the logical structure of documents in contentoriented XML retrieval can be beneficial for users of XML retrieval systems. However, research into structured document retrieval has so far not systematically examined how structure can be used to facilitate the search process of users. We investigate how users of an XML retrieval system can be supported in their search process, if at all, through summarisation. To answer this question, an interactive information retrieval system was developed and a study using human searchers was conducted. The results show that searchers actively utilise the provided summaries, and that summary usage varied at different levels of the XML document structure. The results have implications for the design of interactive XML retrieval systems. 1
Progress in Information Retrieval.
The economic feasibility of maintaining large databases of document images has created a tremendous demand for robust ways to access and manipulate the information these images contain. In an attempt to move toward a paper-less office, large quantities of printed documents are often scanned and archived as images, without adequate index information.  One way to provide traditional database indexing and retrieval capabilities is to fully convert the document to an electronic representation which can be indexed automatically. Unfortunately, there are many factors which prohibit complete conversion including high cost, low document quality, and the fact that many non-text components cannot be adequately represented in a converted form. In such cases, it can be advantageous to maintain a copy of and use the document in image form.  In this paper, we provide a survey of methods developed by researchers to access and manipulate document images without the need for complete and accurate conve...
Overview of INEX 2006.
Abstract. Since 2002, INEX has been working towards the goal of establishing an infrastructure, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of content-oriented XML retrieval systems. This paper provides an overview of the work carried out as part of INEX 2006. 1
INEX 2006 Evaluation Measures.
Abstract. This paper describes the official measures of retrieval effectiveness employed at the ad hoc track of INEX 2006. 1
Using Topic Shifts in XML Retrieval at INEX 2006.

Advances in XML retrieval the INEX initiative.

Investigating the use of summarisation for interactive XML retrieval.
As the number of components in XML documents is much larger than that of ‘flat ’ documents, we believe it is essential to provide users of XML information retrieval systems with overviews of the content of retrieved elements. In this paper, we investigate the use of summarisation in XML retrieval as a means of helping users in their searching process. 1.
A Scalable Framework for Multimedia Knowledge Management.
management

User expectations from XML element retrieval.


Strict and vague interpretation of XML%2Dretrieval queries.

Why structural hints in queries do not help XML%2Dretrieval.

eXtended cumulated gain measures for the evaluation of content%2Doriented XML retrieval.

Special issue on model design

Best entry points for structured document retrieval %2D Part I Characteristics.

Best entry points for structured document retrieval %2D Part II Types

Evaluating the effectiveness of content%2Doriented XML retrieval methods.

Report on the ad%2Dhoc track of the INEX 2005 workshop.

The SIGIR 2006 workshop program.

XML search languages%2C INEX and scoring.

Advances in XML Information Retrieval

Learning to summarise XML documents using content and structure.

INEX 2005 Evaluation Measures.
Abstract. This paper describes the official measures of retrieval effectiveness employed in INEX 2005: the eXtended Cumulated Gain (XCG) measures. In addition, results of correlation analysis are reported, examining the correlation between the employed quantisation functions and the different measures for the INEX 2005 ad-hoc tasks. 1
Overview of INEX 2005.
Abstract. Since 2002, INEX has been working towards the goal of establishing an infrastructure, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of content-oriented XML retrieval systems. This paper provides an overview of the work carried out as part of INEX 2005. 1
INEX 2005 Evaluation Measures.
Abstract. This paper describes the official measures of retrieval effectiveness employed in INEX 2005: the eXtended Cumulated Gain (XCG) measures. In addition, results of correlation analysis are reported, examining the correlation between the employed quantisation functions and the different measures for the INEX 2005 ad-hoc tasks. 1
INEX 2005 Multimedia Track.

The Interpretation of CAS.
Abstract. There has been much debate over how to interpret the structure in queries that contain structural hints. At INEX 2003 and 2004, there were two interpretations: SCAS in which the user specified target element was interpreted strictly, and VCAS in which it was interpreted vaguely. But how many ways are there that the query could be interpreted? In the investigation at INEX 2005 (discussed herein) four different interpretations were proposed, and compared on the same queries. Those interpretations (SSCAS, SVCAS, VSCAS, and VVCAS) are the four interpretations possible by interpreting the target elements, and the support elements, either strictly or vaguely. An analysis of the submitted runs shows that those that share an interpretation of the target element correlate- that is, the previous decision to divide CAS into the SCAS and VCAS (as done at INEX 2003 and 2004) was sound. The analysis is supported by the fact that the best performing VSCAS run was submitted to the VVCAS task and the best performing SVCAS run was submitted to the SSCAS task. 1
Modelling Good Entry Pages on the Web.

A Metadata Model Supporting Scalable Interactive TV Services.
In this paper, we introduce a novel metadata model for describing scalable and interactive TV services that can  be enriched with supplemental multimedia information. The  model allows users to access such TV services not only via  their traditional TV sets, but also via additional mobile devices  like TabletPCs or PDAs. To achieve this, we segment  the traditional linear program into sub-components, while separating device-independent and device-specific metadata. A realization of this model builds on the existing standards of TV-Anytime, MPEG-7 and MPEG-21. The model achieves a step towards the &#034;Connected world&#034; vision of  the second specification phase of the TV-Anytime forum.
XML Multimedia Retrieval.

Guest Editorial Spaces

Introduction to the Special Issue on INEX.

Providing consistent and exhaustive relevance assessments for XML retrieval evaluation.

Report on the INEX 2005 workshop on element retrieval methodology.

Providing consistent and exhaustive relevance assessments for XML retrieval evaluation.

Interface pour l%27%E9valuation de syst%E8mes de recherche sur des documents XML.

Modelling XML retrieval with belief functions.

A Study of the Assessment of Relevance for the INEX%2702 Test Collection.
We investigate possible assessment trends and inconsistencies within  the collected relevance assessments of the INEX&#039;02 test collection in order to  provide a critical analysis of the employed relevance criterion and assessment  procedure for the evaluation of content-oriented XML retrieval approaches.
Modelling Vague Content and Structure Querying in XML Retrieval with a Probabilistic Object%2DRelational Framework.
Many XML retrieval applications require relevance-oriented  ranking of retrieved elements in order to capture the vagueness inherent  to the information retrieval process. This relevance-oriented ranking  should not only support vagueness at the content level, but also at the  structural level. In this paper, we use a probabilistic object-relational  framework to model representation and retrieval strategies that take  into account vagueness at both content and structure level. Our approach  makes use of established database technology combined with sound probability  theory, thus allowing for fast and flexible prototyping of various  representation and retrieval strategies.
Overview of INEX 2004.

Reliability Tests for the XCG and inex%2D2002 Metrics.
Abstract. In this paper we compare the effectiveness scores and system rankings obtained with the inex-2002 metric, the official measure of INEX 2004, and the XCG metrics proposed in [4] and further developed here. For the comparisons, we use simulated runs as we can easily derive the desired system rankings that a reliable measure should produce based on a predefined set of user preferences. The results indicate that the XCG metrics are better suited for comparing systems for the INEX content-only (CO) task, where systems aim to return the highest scoring elements according to the user preferences reflected in a quantisation function, while also aiming to avoid returning overlapping components. 1
Tolerance to Irrelevance A User%2Deffort Evaluation of Retrieval Systems without Predefined Retrieval Unit.

Integrating XLink and XPath to Retrieve Structured Multimedia Documents in Digital Libraries.
To support the retrieval of multimedia data according to user information needs, multimedia information retrieval in digital libraries must be based on semantics and not just primitive features of multimedia objects. In this paper, we investigate the intersection of the hierarchical and linking structural information with the content information to support the retrieval of multimedia data in digital libraries based on XML format. For this purpose, we integrate XLink and XPath information to exploit the intersection of hierarchical and linking information within XML-based multimedia documents.
The overlap problem in content%2Doriented XML retrieval evaluation.
Within the INitiative for the Evaluation of XML Retrieval (INEX) a number of metrics to evaluate the effectiveness of content-oriented XML retrieval approaches were developed. Although these metrics provide a solution towards addressing the problem of overlapping result elements, they do not consider the problem of overlapping reference components within the recall-base, thus leading to skewed effectiveness scores. We propose alternative metrics that aim to provide a solution to both overlap issues.
Combining evidence for Web retrieval using the inference network model an experimental study.

A report on the first year of the INitiative for the Evaluation of XML retrieval.
this article, we provide an overview of the first round of the INEX initiative
Report on the INEX 2003 workshop.
This paper reports on the work presented and discussed at the workshop
Automatic identification of best entry points for focused structured document retrieval.


Construction of a Test Collection for the Focussed Retrieval of Structured Documents.
Abstract. In this paper, we examine the methodological issues involved in constructing test collections of structured documents and obtaining best entry points for the evaluation of the focussed retrieval of document components. We describe a pilot test of the proposed test collection construction methodology performed on a document collection of Shakespeare plays. In our analysis, we examine the effect of query complexity and type on overall query difficulty, the use of multiple relevance judges for each query, the problem of obtaining exhaustive relevance assessments from participants, and the method of eliciting relevance assessments and best entry points. Our findings indicate that the methodology is indeed feasible in this small-scale context, and merits further investigation. 1
The INEX Evaluation Initiative.
Introduction  The widespread use of the extensible Markup Language (XML) on the Web and in Digital Libraries brought about an explosion in the development of XML tools, including systems to store and access XML content. As the number of these systems increases, so is the need to assess their benefit to users. The benefit to a given user depends largely on which aspects of the user&#039;s interaction with the system are being considered. These aspects, among others, include response time, required user e#ort, usability, and the system&#039;s ability to present the user with the desired information. Users then base their decision whether they are more satisfied with one system or another on a prioritised combination of these factors.  The Initiative for the Evaluation of XML Retrieval (INEX) was set up at the beginning of 2002 with the aim to establish an infrastructure and provide means, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of content-orie
Four%2DValued Knowledge Augmentation for Structured Document Retrieval.

Mathematical
this paper, we focus on the translation modeling problem. Before we turn to this problem, however, we should address an issue that may be a concern to some readers: Why do we estimate Pr(e) and Pr(fle) rather than estimate Pr(elf ) directly? We are really interested in this latter probability. Wouldn&#039;t we reduce our problems from three to two by this direct approach? If we can estimate Pr(fle) adequately, why can&#039;t we just turn the whole process around to estimate Pr(elf)? To understand this, imagine that we divide French and English strings into those that are well-formed and those that are ill-formed. This is not a precise notion. We have in mind that strings like Il va la bibliothque, or I live in a house, or even Colorless green ideas sleep furiously are well-formed, but that strings like lava I1 bibliothque or a I in live house are not. When we translate a French string into English, we can think of ourselves as springing from a well-formed French string into the sea of well-formed English strings with the hope of landing on a good one. It is important, therefore, that our model for Pr(elf ) concentrate its probability as much as possible on wellformed English strings. But it is not important that our model for Pr(fle ) concentrate its probability on well-formed French strings. If we were to reduce the probability of all well-formed French strings by the same factor, spreading the probability thus  265 liberated over ill-formed French strings, there would be no effect on our translations: the argument that maximizes some function f(x) also maximizes cf(x) for any positive constant c. As we shall see below, our translation models are prodigal, spraying probability all over the place, most of it on ill-formed French strings. In fact, as we discuss in Section 4.5, two...

Proceedings of the First Workshop of the INitiative for the Evaluation of XML Retrieval %28INEX%29
Preface The widespread use of XML in digital libraries, product catalogues, scientific data repositories and across the Web prompted the development of appropriate retrieval (searching and browsing) methods for XML documents. This in turn led to the need to evaluate the developed XML retrieval systems. As part of a large-scale effort to improve the efficiency of research in information retrieval and digital libraries, the INitiative for the Evaluation of XML retrieval (INEX) has started an international, coordinated effort to promote evaluation procedures for content-based XML retrieval. The aim of the INEX initiative is to provide means, in the form of a large XML test collection and appropriate scoring methods, for the evaluation of XML retrieval systems. During the first year of the evaluation effort, in 2002, participating organisations contributed to the building of a large-scale XML test collection by creating topics, performing retrieval runs and providing relevance assessments (along two relevance dimensions) for XML components of varying granularity. The INEX Workshop, held at the Schloss Dagstuhl Research Centre, concluded the results of this large-scale effort, summarised and addressed the encountered issues and devised a workplan for the evaluation of XML retrieval systems. The workshop brought together researchers in the field of XML retrieval and, in particular, researchers who participated in INEX 2002. The workshop was organised into presentation and workshop sessions. During the presentation sessions participants had the opportunity to present their approaches to XML indexing and retrieval. The workshop sessions served as discussion forums to review issues related to the creation of INEX topics, the specification of the retrieval result submission format, the definition of the two relevance dimensions and the use of the online assessment system provided by INEX. The results of these discussions have provided valuable input for the organisation of INEX 2003. Finally, the workshops on evaluation measures aimed to provide a forum to develop guidelines and procedures for the evaluation of XML retrieval systems based on the employed relevance dimensions. As a result, the discussed evaluation metrics have been implemented and applied to the INEX 2002 submissions. This proceeding contains a collection of papers describing the research of the INEX 2002 participants. The papers have been grouped according to the approach to XML retrieval that they report on. The categories have been defined using the following definitions: · IR-oriented: Research groups that focus on the extension of a specific type of information retrieval (IR) model, which they have applied to standard IR test collections in the past, to deal with XML documents. · DB-oriented: Groups that are working on extending database (DB) management systems to deal with semistructured data

The Accessibility Dimension for Structured Document Retrieval.
Structured document retrieval aims at retrieving document  components that best satisfy a query, instead of merely retrieving predefined  document units. This paper reports on an investigation of a  idf-acc approach, where tf and idf are the classical term fi&#039;equency and  inverse document frequency, and acc, a new parameter called accessibility,  that captures the structure of documents. The tf-idf-acc approach  is defined using a probabilistic relational algebra. To investigate the retrieval  quality and estimate the acc values, we developed a method that  automatically constructs diverse test collections of structured documents  from a standard test collection, with which experiments were carried out.
Combining Web Document Representations in a Bayesian Inference Network Model Using Link and Content%2DBased Evidence.

A Formal Model for Data Fusion.


Video retrieval using an MPEG%2D7 based inference network.
This work proposes a model for video retrieval based upon the inference network model. The document network is constructed using video metadata encoded using MPEG-7 and captures information pertaining to the structural aspects (video breakdown into shots and scenes), conceptual aspects (video, scene and shot content) and contextual aspects (context information about the position of conceptual content within the document). The retrieval process a) exploits the distribution of evidence among the shots to perform ranking of different levels of granularity, b) addresses the idea that evidence may be inherited during evaluation, and c) exploits the contextual information to perform constrained queries.
Focussed Structured Document Retrieval.
Focussed structured document retrieval aims at retrieving best entry  points from where users can browse to access relevant document components in  the document structure. In this paper, we report on the development, implementation  and evaluation of best entry point retrieval strategies derived from  user studies designed to elicit what constitutes a best entry point.
Using Dempster%2DShafer%27s Theory of Evidence to Combine Aspects of Information Use.
In this paper we propose a model for relevance feedback. Our model combines evidence from user&#039;s  relevance assessments with algorithms describing how words are used within documents. We motivate  the use of the Dempster-Shafer framework as an appropriate theory for modelling combination of  evidence. This model also incorporates the uncertain nature of information retrieval and relevance  feedback. We discuss the sources of uncertainty in combining evidence in information retrievel and the  importance of combining evidence in relevance feedback. We also present results from a series of  experiments that highlight various aspects of our approach and discuss our findings.
Combining and selecting characteristics of information use.
In this paper we report on a series of experiments designed to investigate the combination of term and document weighting functions in Information Retrieval. We describe a series of weighting functions, each of which is based on how information is used within documents and collections, and use these weighting functions in two types of experiments: one based on combination of evidence for ad-hoc retrieval, the other based on selective combination of evidence within a relevance feedback situation. We discuss the difficulties involved in predicting good combinations of evidence for ad-hoc retrieval, and suggest the factors that may lead to the success or failure of combination. We also demonstrate how, in a relevance feedback situation, the relevance assessments can provide a good indication of how evidence should be selected for query term weighting. The use of relevance information to guide the combination process is shown to reduce the variability inherent in combination of evidence.
Report on ACM sigir workshop on mathematical%2Fformal methods in information retrieval.

Report on ACM SIGIR workshop on mathematical%2Fformal methods in information retrieval.



Empirical Investigations on Query Modification Using Abductive Explanations.
In this paper we report on a series of experiments designed to  investigate query modification techniques motivated by the area  of abductive reasoning. In particular we use the notion of  abductive explanation, explanations being a description of data  that highlight important features of the data. We describe several  methods of creating abductive explanations, exploring term  reweighting and query reformulation techniques and demonstrate  their suitability for relevance feedback.
A Model for the Representation and Focussed Retrieval of Structured Documents Based on Fuzzy Aggregation.
Effective retrieval of structured documents should exploit the content and structural knowledge associated with the documents. This knowledge can be used to focus retrieval to the best entry points: document components that contain relevant information, and from which users can browse to retrieve further relevant components. To enable this, suitable representation methods must be developed.  This paper presents a model for representing structured documents to allow for their focussed retrieval. The model is founded on fuzzy aggregation, an approach based on the fuzzy representation of linguistic quantifiers and ordered weighted averaging operators. By defining the representation of a document component as the fuzzy aggregation of its related components, we arrive at a document representation that supports the selection of best entry points.  1 
Broadcast technologies for disseminating cultural heritage.

Logic and Uncertainty in Information Retrieval.
The use of logic in Information Retrieval (IR) enables one to  formulate models that are more general than other well known IR models.
Concepts for a Graphical User Interface for Hypermedia Retrieval.
Which concepts are general and specific enough to support hypermedia retrieval? We present in this paper a graphical user interface that makes explicit the following three key concepts for hypermedia retrieval: content of documents, facts about documents and structure of documents. The underlying model is based on a probabilistic object-oriented logic (POOL) that enables content-based querying, fact-based querying, and the exploitation of the structural nature of hypermedia documents. In this paper, we focus on the graphical user interface which reflects the expressiveness of POOL for querying hypermedia documents. We report on the plication of the system using a heterogeneous collection of hypermedia documents. 1 
A Dempster%2DShafer indexing for the focused retrieval of a hierarchically structured document space Implementation and experiments on a web museum collection.

Improving Formal Models and Usability Research in IR at Glasgow University %2D Introduction.

Combining Document Representations.

ACM SIGIR 2000 Workshop on Mathematical%2FFormal Methods in Information Retrieval.

A Probabilistic Description%2DOriented Approach for Categorizing Web Documents.

Selective Relevance Feedback Using Term Characteristics.
: This paper presents a new relevance feedback technique; selectively combining evidence based on the usage of terms within documents. By considering how terms are used within documents, we can better describe the features that might make a document relevant and thus improve retrieval effectiveness. In this paper we present an initial, experimental investigation of this technique, incorporating new and existing measures for describing the information content of a document. The results from these experiments positively support our hypothesis that extending relevance feedback to take into account how terms are used within documents can improve the performance of relevance feedback. 1. Introduction  The particular characteristics of digital libraries - large, diverse collections - mean that the access methods to these collections must support how users search for information. In particular, access methods must provide a wider range of techniques to allow the user to specify what makes an ...
A Framework for Investigating the Interaction in Information Retrieval.
. To increase retrieval effectiveness, information retrieval systems  must offer better support to users in their information-seeking  activities. To achieve this, one major concern is to obtain a better  understanding of the nature of the interaction between a user and an  information retrieval system. For this, we need a means to analyse the  interaction in information retrieval, so as to compare the interaction  processes within and across information retrieval systems.  We present a framework for investigating the interaction between  users and information retrieval systems. The framework is based on  channel theory, a theory of information and its flow, which provides an  explicit ontology that can be used to represent any aspect of the interaction  process. The developed framework allows for the investigation of  the interaction in information retrieval at the desired level of abstraction.  We use the framework to investigate the interaction in query reformulation  and standard web searching.  1 
A Model for Representing and Retrieving Heterogeneous Structured Documents Based on Evidential Reasoning.
Documents often display an internal structure; they are composed of components. For example, a journal contains several articles, which themselves contain paragraphs, tables, etc. With structured documents, the retrievable units should be the document components as well as the whole document. The components of a structured document can be of different types: various media, located in a number of sites, or written in several languages. An information retrieval model for heterogeneous structured documents must take into account this disparity among document components. We present a model for representing and retrieving heterogeneous structured documents, that is multimedia, distributed and multilingual documents. The model is based on evidential reasoning, a formal theory that allows for the representation and the combination of knowledge. Here, knowledge is the content of document components. We show that the model provides for an appropriate representation and retrieval of ...
Information retrieval and Dempster%2DShafer%27s theory of evidence.

A Dempster%2DShafer Model for Document Retrieval using Noun Phrases.
In this paper, we propose a document retrieval system based on natural language processing of documents and  queries. We use single terms and term groups as indexing elements to represent documents and queries. The model is  formally expressed within the Dempster-Shafer Theory of Evidence. We discuss in detail how we use this theory to  represent a document collection, indexing elements, documents and queries. The retrieval function is derived directly  from the underlying theory. We then present an implementation of the model. The experimental work carried out is  reported last.  1 Introduction  Document retrieval (DR) systems focus on the problem of retrieving documents relevant to a user&#039;s information need represented as a query. In this work, we concentrate on text-based systems. Traditional DR models usually represent documents and queries as a set of keywords. Hence, they cannot handle the diversity of the human language. Their simplistic representational approaches cannot, for e...
%60%60Is This Document Relevant%3F ... Probably%27%27 A Survey of Probabilistic Models in Information Retrieval.
This article surveys probabilistic approaches to modeling information retrieval. The  basic concepts of probabilistic approaches to information retrieval are outlined and  the principles and assumptions upon which the approaches are based are  presented. The various models proposed in the development of IR are described,  classified, and compared using a common formalism. New approaches that  constitute the basis of future research are described
Logical Models in Information Retrieval Introduction and Overview.
The use of logic to model the information retrieval process  has become an established research area. Nevertheless, many people in the  information retrieval community do not yet appreciate the work performed in  this area, mainly because they do not understand logical formalisms, and hence  cannot see the connection between logic and information retrieval. This paper  aims at resolving the problem. It introduces the formalisms used in logical models  for information retrieval, shows the use of logic to build the models, and presents  a brief overview of some of the current logical models in information retrieval.  2  1 INTRODUCTION  It has been argued that current information retrieval (IR) models offer only simplistic and specific representations of information (Chiaramella and Chevallet, 1992, Nie, 1990, van Rijsbergen, 1989). There is, therefore, a need for the development of a new formalism able to model IR systems in a more generic manner, hence capturing information as it appear...
Dempster%2DShafer%27s Theory of Evidence Applied to Structured Documents Modelling Uncertainty.
Documents often display a structure determined by the author, e.g., several chapters, each with several sub-chapters and so on. Taking into account the structure of a document allows the retrieval process to focus on those parts of the documents that are most relevant to an information need. Chiaramella et al advanced a model for indexing and retrieving structured documents. Their aim was to express the model within a framework based on formal logics with associated theories. They developed the logical formalism of the model. This paper adds to this model a theory of uncertainty, the Dempster-Shafer theory of evidence. It is shown that the theory provides a rule, the Dempster&#039;s combination rule, that allows the expression of  the uncertainty with respect to parts of a document, and that is compatible with the logical model developed by Chiaramella et al.
Short Queries
Ad-hoc queries are usually short, of perhaps two to ten terms. However, in previous rounds of TREC we have concentrated on obtaining optimal performance for the long TREC topics. In this paper we investigate the behaviour of similarity measures on short queries, and show experimentally that two successful measures---which give similar, good performance on long  TREC topics---do not work well for short queries. We explore methods for achieving greater effectiveness for short queries, and conclude that a successful approach is to combine these similarity measures with other evidence. We also briefly describe our experiments with the Spanish data. 1 Introduction  Users of interactive text retrieval systems often pose short queries, typically of a few words only. Our experience with users of real systems who pose such queries is that they are unsatisfied with the behaviour of standard similarity measures such as cosine, reporting that the answers often have little apparent correspondence t...
Information Calculus for Information Retrieval.

Information Retrieval and Situation Theory.
This paper is an essay to convince the reader that Situation Theory presents many characteristics that are both adequate and appropriate for the study of IR. Here we concentrate on the ones we have experience with:
Situation Theory and Dempster%2DShafer%27s Theory of Evidence for Information Retrieval.

